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Empirical  Bayes  Rules  for  Selecting 
Good  Binomial  Populations 

1 .  Introduction 

The  empirical  Bayes  approach  in  statistical  decision  theory  is  appropriate 
when  one  is  confronted  repeatedly  and  independently  with  the  same  decision 
problem.  In  such  instances,  it  is  reasonable  to  formulate  the  component 
problem  in  the  sequence  as  Bayes  decision  problems  with  respect  to  an  unknown 
prior  distribution  on  the  parameter  space  and  then  use  the  accumulated 
observations  to  improve  the  decision  rule  at  each  stage.  This  approach  is 
due  to  Robbins  (1955,  1964).  Many  such  empirical  Bayes  rules  have  been 
shown  to  be  asymptotically  optimal  in  the  sense  that  the  risk  for  the  nth 
decision  problem  converges  to  the  optimal  Bayes  risk  which  would  have  been 
obtained  if  the  prior  distribution  was  known  and  the  Bayes  rule  with  respect 
to  this  prior  distribution  was  used. 

Empirical  Bayes  rules  have  been  derived  for  multiple  decision  problems 
by  Deely  (1965).  He  considered  selecting  a  subset  containing  the  best 
population.  Van  Ryzin  (1970),  Huang  (1975),  Van  Ryzin  and  Susarla  (1977) 
and  Singh  (1977)  also  studied  some  multiple  decision  problems  by  using 
empirical  Bayes  approach.  Recently,  Gupta  and  Hsiao  (1983)  studied  some 
empirical  Bayes  rules  for  selecting  good  populations  with  respect  to  a 
standard  or  a  control.  In  their  paper,  the  underlying  population  ir^  is 
uniformly  distributed  with  parameter  i  =  0,1, ...,k,  and  ttq  is  a  control 
population,  is  said  to  be  good  if  ei  >_  8q  and  to  be  bad  if  e,.  <  6q. 

Let  ac{l,...,k}  be  an  action.  When  action  a  is  taken,  it  means  that  ^ 
is  selected  as  good  if  i€a,  and  excluded  as  bad  if  i^a.  With  the  loss 

.  .1/ 
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function  L(j..)  =  |  <  V^'fO.ej'V  +  I(Y90>  1  (en,-)<9j > •  where 

Jfca  U  Jtf®  U 

0  =  (6g,6-j .  ,0^) ,  they  proposed  some  empirical  Bayes  rules  for  the  problem  of 
selecting  good  populations  with  respect  to  a  standard  or  a  control. 

For  a  similar  problem,  if  the  underlying  populations  have  binomial 
distribution,  then,  in  general,  it  is  impossible  to  find  a  sequence  of 
empirical  Bayes  rules  which  is  asymptotically  optimal  in  the  sense  mentioned 
above  (see  Robbins  (1964),  Samuel  (1963)  and  Singh  (1977)).  In  this  paper, 
we  are  concerned  with  this  problem.  Two  cases  have  been  studied:  one  is 
that  the  prior  distribution  is  completely  unknown  and  the  other  is  that  the 
prior  distribution  is  symmetrical  about  p  =  §  ,  but  its  form  is  still  unknown. 
In  each  case,  empirical  Bayes  rules  are  derived  and  the  rate  of  convergence 
of  corresponding  empirical  Bayes  rules  is  also  studied.  In  each  case,  it 
is  found  that  the  order  of  the  rate  of  convergence  is  Ofexpf-c^n))  for  some 
ci  >  0,  i  =  1,2.  For  the  case  when  the  prior  distribution  is  symmetrical  about 
p  =  |  ,  in  order  to  improve  the  performance  of  the  sequence  of  empirical  Bayes 
rules,  two  smoothing  methods  are  studied.  Some  Monte  Carlo  studies  have 
also  been  carried  out.  The  results  indicate  that  the  smoothed  competitors 
actually  perform  better  than  the  original  empirical  Bayes  rules. 


2.  Formulation  of  the  Empirical  Bayes  Approach 

Let  ttq,  TTp...,!^  denote  k  +  1  populations  and  let  be  a  random 
observation  from  *. .  Assume  that  ^  B(N^.p^),  where  p^  €  (0,1)  and  N.-  is 
fixed  and  known.  Let  ug  be  the  control  population.  For  each  i  s  l,...,k, 
population  tt ^  is  said  to  be  good  if  p.  >  pg  and  to  be  bad  if  p-  <  Pg,  where 
the  control  parameter  Pg  is  either  known  or  unknown.  Our  goal  is  to  derive 
some  empirical  Bayes  rules  to  select  all  the  good  populations  and  exclude 
all  the  bad  populations. 


,  m  m  m  ^  , 


When  the  control  parameter  pQ  is  known,  the  empirical  Bayes  framework 

can  be  formulated  as  follows: 

(1)  Let  n  =  {£]£  *  (p-|,...,pk),  p.j  e(0,l )  for  i  =  1,2,. ..,k}.  For  each 
£en,  define  A(j>)  =  { i | pi  >  pQ},  B(jg)  =  {i|p1  <  pQ}.  That  is,  A(^)(B(jg)) 
is  the  set  of  indices  of  good  (bad)  populations. 

(2)  Let  A  =  { a | a  c{l,2,...,k}}  be  the  action  space.  When  action  a  is 
taken,  it  means  that  population  tt ^  is  selected  as  a  good  population  if 
iea,  and  excluded  as  a  bad  population  if  i^a. 

(3)  The  loss  function  L(jg,a)  is  defined  as  follows: 


L(*,a) (prpo)  + .  ,(po'pi) 

i£A(p)-a  iea-A(p) 


(2.1) 


where  the  first  summation  is  the  loss  due  to  not  selecting  some  good 
populations  and  the  second  summation  is  the  loss  due  to  selecting  some 
bad  populations. 


IV 

(4)  Let  dG(j))  =  n  dG^p^ )  be  the  prior  distribution  over  the  parameter 

space  n,  where  G..(*)  are  unknown  for  all  i  =  l,2,...,k. 

(5)  For  each  i,  let  (X...P..),  i  =  1,2,...,  be  pairs  of  random  variables 

I  J  I  J 

associated  with  population  tt. ,  where  X.  .  is  observable  but  P. .  is  not 

I  I J  I J 

observable.  has  distribution  G...  Conditional  on  P^  =  p^,  X.j 
is  binomially  distributed  with  parameters  and  p^j.  Some  additional 
observations  Y. .  =  (Y. Y..  )  are  also  available.  Conditional  on 

j  I  j  i  1  jn^ 

Pij  =  pij’  Xij  and  Yijm’  m  =  1****»ni»  are  i  •  "i  *  The  jth  stage 
observations  are  denoted  by  Zj.  That  is,  ^  =  ((X^,  ^ ),..., 

^Xkj ’  Xkj  ^  * 
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(6)  Let  X  =  (X,,...,X.)  be  the  present  observation.  Conditional  on 

*v»  I  K 

^  *  (p1,...»P|c),  X  has  probability  function 


Ni 

(1-pJ  1 


Finally,  since  we  are  interested  in  Bayes  rule,  we  can  restrict  our 
attention  to  the  nonrandomi zed  rules. 

(7)  Let  D  =  { d  |  d  :  x  -*■  A,  being  measurable)  be  the  set  of  nonrandomi  zed 

k 

rules,  where  x  =  n  {0,1, ...,N.}.  For  each  deD,  let  r(G,d)  denote  the 
i=l  1 

associated  Bayes  risk.  Then,  r(G)  =  inf  r(G,d)  is  the  minimum  Bayes  risk. 

deD 

When  the  control  parameter  pQ  is  unknown,  for  the  related  framework, 
the  indices  in  the  associated  notations  should  begin  at  0  instead  of  at  1. 

In  the  sequel,  (0)  will  be  used  to  show  this  additional  fact. 

We  now  consider  decision  rules  dn(£,  £-|,...,£n)  whose  form  depends  on 
£  and  j  =  l,...,n.  Let  r(G,dn)  be  the  Bayes  risk  associated  with  decision 

rule  dn(*‘  ^l“**^n)'  That  is’ 


r(G,dn)  .  l  E  /  L(£,dn(*,  ^ . £n»  f(*l«)  dG(jj) 

££x  n 

where  the  expectation  E  is  taken  with  respect  to  (j^,. ..,£).  For  simplicity, 
dn(£’  &•  — Wil1  be  denoted  b*  dn(^)- 

Definition  2.1.  A  sequence  of  decision  rules  ^dn(^))n=l  said  t0  be 
asymptotically  optimal  (a.o.)  relative  to  the  prior  distribution  G  if 
r(G,dn)  -►  r(G)  as  n  -*■  ». 


For  constructing  a  sequence  of  a.o.  rules,  we  first  need  to  find  the 


minimum  Bayes  risk  and  the  associated  Bayes  rule,  say  dg.  From  (2.1),  the 
Bayes  risk  associated  with  decision  rule  d  is 

r(G.d)  =  l  I  /Q  (P0  -  Pi)  dG(jj) 

XeX  1ea($) 

(2.; 

+  J  j,  4  •  po>I(Po,i)(|Ji>f('siu)  *<?>• 

where  IA(.)  is  the  indicator  function  of  set  A. 

The  second  term  in  the  right-hand  side  of  (2.2)  is  a  constant  and  does 
not  affect  the  determination  of  the  Bayes  rule. 

Let  $ i g(x)  =  J  (p0  -  Pj )f(x|jg)dG(jg).  After  integration,  one  obtains 

j,  W 

J>i 

p0f i ( xi )  "  wi^xl)  if  Po  is  known; 

wo(xo)fi  (xi )  "  WW  1f  p0  is  unknown» 

1 

f.-(x)  •  /  f.(x|p)  dG.(p)  and 

I  Q  I 

1  1  /  N A  N.-x 

«i(x)  =  J  pfi(x|p)dG.(p)  =  /  ( 1 )px 1 (1-p)  dG.(p). 


(2. 


Since  f^(x),  the  marginal  probability  function  of  X..,  is  always  positive 
for  all  x  =  0,1,...,N,.,  i  =  (0),  l,...,k,  the  Bayes  rule  dg  can  be  obtained 
as  follows: 


W  =  {ilAiG(^  1  0K 


(2.4) 


Now,  for  each  i  =  (0),  l,...,k,  and  for  each  n  =  1,2,...,  let 

Win(V  E  Win(V  (X11  ’Xi  1 5  *  *  *  *  ’ ^in*^in^  be  an  estimator  W^(x^)  and 

fin(xi}  -  fin(xi;  (X11*lll)»***»(Xin»Xin))  be  an  estiroator  of  W* 

Def i ne 


W0n(x0  )fin(x)  "  Win(xi )f0n(x0}  if  p0  is  unknown; 

AinW  =  j  (2-5> 

PqW  "  win(xi )  1f  P0  is  known; 


and 


=  {1lainW  -  0h  (2>6) 

If  W^n(x)  ^  W..(x)  and  f^n(x)  £  f^x)  for  all  x  =  0,1, ...,N.  where 
"  ^  "  means  convergence  in  probability,  then  A^n(^)  £  AiG(x)  for  all  xex- 
Therefore,  from  a  corollary  of  Robbins  (1964),  it  follows  that  r(G,dp)  -*  r(G) 
as  n  -*■  «.  So,  the  sequence  of  decision  rules  {dn(jc)}  defined  in  (2.6)  is 
asymptotically  optimal  for  our  selection  problem.  Hence,  in  the  following, 
all  we  have  to  do  is  to  find  sequences  of  estimators,  say  (W^n(x)}  and  { f ^ n ( x) } 
1  =  (0),l,...,k,  satisfying  W.  (x)  £  W.(x)  and  f.  (x)  K  f  (x)  for  all  x  =  0,1,. 


3.  Case  when  the  Prior  Distribution  is  Completely  Unknown 


Robbins  (1964)  and  Samuel  (1963),  respectively,  pointed  out  that  there 
was  no  way  of  approximating  W^x)  just  by  using  the  observations  (X^,...*X^n). 
In  order  to  remedy  this  deficiency,  we  take,  at  each  stage,  some  more  observa¬ 
tions  (Y^ j-j .... ,Y^ )  in  our  model  where  n^  can  be  any  positive  integer. 

For  simplicity,  let  n^  =  1  for  all  i  =  (0),l,...,k. 

Estimation  of  W^(x)  and  f^(x) 

A  usual  estimator  of  f^ (x)  can  be  given  as  follows: 


fin*x)  =  n  1  {x>  (Xij)  for  x  =  0,1 . V 


(3.1) 


Then  f^n(x)  is  an  unbiased  estimator  of  f^(x),  and  by  the  strong  law  of 
large  numbers,  f^n(x)  -*•  fj(x)  with  probability  1  for  each  x  =  0,1,. ...N^. 
Hence,  fin(x)  S  f^(x)  for  all  x  =  0,1,. ..,N^. 

For  the  estimation  of  (x),  we  consider  the  following.  Define 


V‘>  *  Yij 


(3.2) 


Under  the  condition  (5)  of  Section  2,  it  is  easy  to  see  that  E[V.  . (x) ]  = 

■  J 

N^W.j(x).  We  then  define 


“in'*’  "ff  X  Vx)/Nr 

J  ' 


(3.3) 


Since  V^x),  i  =  1,2,...,  are  i.i.d.  and  bound,  it  is  easy  to  show  that 

w<«(x)-»Wi (x)  with  probability  one  for  all  x  =  0,1,..., N. .  Now,  let  A.„(x) 

I n  i  l  in  ^ 

and  d  (x)  be  defined  In  (2.5)  and  (2.6),  respectively.  From  the  discussion 
n  ^ 


of  Section  2  and  the  construction  of  the  sequence  of  decision  rules 
(dn}“_^  through  (2.5),  (2.6),  (3.1)  and  (3.3),  we  get  the  following  result. 
Theorem  3.1 .  For  our  decision  problem,  the  sequence  of  decision  rules 
{dn}"_i  is  asymptotically  optimal  relative  to  the  prior  distribution  G. 

Rate  of  Convergence  of  Empirical  Bayes  Rules  (dn } 

Let  a  sequence  of  empirical  Bayes  rules  relative  to  the 

prior  distribution  G.  Since  the  Bayes  rule  dQ  achieves  the  minimum  Bayes 
risk  r(G)  relative  to  G,  r(G,6n)-r(G)  ^0  for  all  n  =  1,2,...  .  Thus,  the 
nonnegative  difference  r(G,6n)  -  r(G)  is  used  as  a  measure  of  the  optimality 
of  the  sequence  of  empirical  Bayes  rules  (6 

Definition  3.1.  The  sequence  of  empirical  Bayes  rules  { 6n >p=-|  is  said  to 

be  asymptotically  optimal  at  least  of  order  an  relative  to  G  if 

r(G,6n)  -  r(G)  <  0(an)  as  n  +  «  where  lim  an  *  0. 

rv*» 

For  each  i  =  l,...,k,  define  Si  =  (xexl  AiG W  <  0}’  Ti  =  {<HAiG(S}  >  01 

Let  e-|  *  min  (-AiG(^c) ) ,  -  min  (a^q(^))  and  e  =  minfe,^).  Since 

SeSi  SeTi 

1  j<  i  <_k  l<i<k 

x  is  a  finite  space,  therefore  e  >  0.  Now, 


0  <  r(G,dn)  -  r(G) 


=  I  E 


led. 


I  &ir(x)  n  f i(x.) 
I„(x)  1G  '  J-l  J  3 
j^i 


n  ^ 


G '  w 


■  i,  X  <-<U,G(*>PUtl,(x)  ’  0)  W 


+  t  =  l  JT.  4<G(iS>Pt4in<«>  i  °> 

1  j/i 

1 1  ySi  pu"'<*)  >  o>  *  jT, -  °i 


where  the  last  inequality  is  due  to  the  fact  that  0  <  f.(x.)  <_  1  and 
lAiG^)l  1  1-  From  (3.4),  it  suffices  to  consider  the  behavior  of 

P(Ain($)  >  0}  when  $eSi  and  that  of  p<Ain($)  -  01  when  £eTi  as  n  ^  " 
each  i  =  1 ,2,... ,k. 

For  each  , 


p{ain<«)  >  01  ■  P(1i„<*>  -  4ig<4>  > 


±P(a(n<«>  -  NgW  >  '> 


When  pQ  is  known, 


Pta1n(i>  »  °>  i  PVir>(xi>  -  Pofi(V  -  win(x1>  +  wi < >  >  *) 


-  P<f1n(xi>  -  >  |>  +  PtMfn(x1)  -  “l «xi »  < 


since  pn  e(0,l). 
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When  Pq  Is  known. 


P{4,n(«)  >  01 


-  P{W0n^x0^f1n^xi^  "  Wii/Xi ^f0r/x0^  ~  W0^x0^f1^xi^  +  w1^xi^f0^x0^  >  c} 
ip{fi„(x)>[“on(xo'  -  VX0>1  »  ?1+Pl«0(x0>[f(n(x.->  '  Vxl»  >  f> 

+  PtfOn^xO^Win^xi^  '  wi^xi^  *  ‘  +  p{wifxi^fOn^xO^  '  *VX0^  x  " 

£  P««0„<*0>  -  “0(x0>  *  T>  +  P(fir<xi>  -  Vxi>  >  !> 

*  ««,„<»,)  -  «,<*,)  <  -  f>  *  P(VX0>  -  VV  <  -  !>•  <3-6> 


In  (3.6),  the  last  inequality  is  due  to  the  fact  that  0  <  W^x^),  f.(x.)  <  1 
and  that  0  _<  W-n(x.j),  f^n(x.j)  1  1  where  the  latter  can  be  easily  checked 
from  (3.1),  (3.2)  and  (3.3). 


(3.5)  and  (3.6)  show  that  it  suffices  to  consider  the  behavior  of 
P*  If in(xi )  ‘  >  and  P{|W.n(xi)  -  (x^)|  >  5}  for  some  6  >  0. 

n 

From  (3.2)  and  (3.3),  W.  (x)-W.(x)  =  l  A. .(x)/n  where  A.  .(x)  = 

m  i  j=1  U  U 

Y1jI{x}^Xij^Ni'wi^x^'  14  1S  easy  to  see  that  A..j(x),  j  =  l,...,n,  are 
i.i.d.  with  mean  0  and  finite  variance,  say  B.(x),  since  |A.-(x)|  5  1. 

I  I  x) 

Therefore,  for  m  >  2, 


E[Alj(x)]  <  E[|A1j(x)|m]  <  E[|A.J(x) |23  =  B1(x)  <  £  B.(x)m!„ 
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Let  Bn(x)  =  ng^x).  Thus,  by  Bernstein's  inequality  (see  Ibragimov 
and  Linnik  (1971),  page  169),  for  any  6  >  0, 


P(|W.n(x)  -  W.(x)|  >  6} 

^  iii 

=  P{|  J  An- j ( x ) |  >  n£  6B~.2  (x)Bn2  (x)>  (3.7) 

J  1 

1  pt I  l_  Aij(x)|  >  2Bn  <x)  minU  n*  (x)»  i  ^  6?  (x) )} 

j  1 

1  2  exp{-  J  min(62e^(x),  ^.(x))}. 

n 

Similarly,  from  (3.1),  f.  (x)  -  f.(x)  =  £  C,,(x)/n  where  C..(x)  = 

1  1J  1 J 

!{x}  (xtj>  -  fi  (x).  Also,  Cij(x),  j  =  l,...,n,  are  i.i.d.  with  mean  0  and 
1  Ci j(x) I  -  1  and  hence  with  fimte  variance,  say  a^x).  Applying  Bernstein's 
inequality  again,  we  obtain 


P{lfinM  -  fj(x)|  >  6}  <  2  exp{-  J  min(52aT1  (x) ,  a^x))}.  (3.8) 

Thus,  we  take  6  =  |  if  pQ  is  unknown  or  take  6  =  |  if  pQ  is  known.  Then, 
from  (3.5)  -v.  (3.8),  for  each  xeS. , 

%  I 


P{Ain(x)  >  0}  <  0(exp{-  J  min(62aT1(x.),  a^))}) 
+  0(exp{-  J  min(62g"1(x.),  g^x.))}). 


(3.9) 
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Following  an  argument  analogous 
given  below: 

For  each  xeT. ,  i  =  l,...,k, 

'Xt  I 


to  the  above,  we  also  get  the  conclusion 


p<Ain(x)  <  0}  5  0(exp{-  ^  min^aT^x.),  •'•.(x..))}) 

+  0(exp{-  J  min(<52BT1(x.),  B^x.))}). 


(3.10) 


Now,  let  c,  =  j-min(b1,b?)  where  b,  =  min  f  min  (6 ^T1  (x) ,  a.(x))l, 

'TKlik  [0<x<N.  1  1  j 

b  =  min  |  min  (62b7^(x),  b.(x))*1,  here  m  =  1  if  pn  is  known  and 

2  m<i<k  |_0<x<Ni  J  ° 


m  =  0  if  pQ  is  unknown.  It  is  clear  that  c-j  >  0  since  B^x)  >  0, 

«.j (x)  >  0  and  x  is  finite.  Thus,  we  have  the  following  theorem: 

Theorem  3.2.  Let  {dn>"_^  be  the  sequence  of  asymptotically  optimal  rules 
described  in  Theorem  3.1.  Then,  r(G,dn)-r(G)  5  0(exp{-c-|n}) for  some  Ci  >  0. 

4.  Case  when  G.. (•)  are  Symmetrical  about  p  =  1/2 

In  this  section,  we  suppose  that  there  Is  sufficient  information  to 
tell  us  that  G..(*)  are  symmetrical  about  p  =  1/2  for  all  i  =  (0),  l,...,k. 
Further,  we  also  assume  that  are  even  integers  for  all  i  =  (0),  l,...,k. 

Estimation  of  W.(x)  and  f^(x) 

- - 1  '  1J — 

Under  the  above  assumptions,  f.(x)  =  fj(N.  -  x)  for  all  x  = 
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to  estimate  f. (x). 

For  w.j (x) ,  x  =  0,1 .... ,N^  we  will  construct  a  sequence  of  consistent 
estimators  {wl n( x) } ,  in  terms  of  f]n(y),  ye(0,l ,. . .  ,N.j },  by  using  the 
observations  (X--,  j  =  l,...,n)  only.  The  following  lemma  is  very  helpful 

'  J 

for  the  above  purpose. 

Lemma  4.1.  Suppose  that  the  prior  distribution  G..(*)  is  symmetric  about 
p  =  1/2.  Then 


(3)  W.j (x)  =  Wi(Ni-x-l)  for  each  x  =  0,1 .  ,Ni  -  1 . 

(b)  W.(x)  +  (N^-x)  =  f^x)  -  f..(N..-x)  for  each  x  *  0,1 . N^. 

/N.\  ,  /N' 

(c)  Furthermore,  if  is  an  even  integer,  then,  j 


Proof:  Direct  computation. 

Theorem  4.1.  Suppose  that  G..(-)  is  symmetric  about  p  =  1/2  and  is 
an  even  integer.  Then,  for  each  x  =  0,1,..., N..,  W^(x)  can  be  represented 
as  a  linear  function  of  f..(y),  y  =  0,1,..., N^. 


Proof:  First,  from  Lemma  4.1  (a)  and  (b),  for  each  x  =  0,1 ,. . .  ,iq-l , 


W^N.-x)  =  fi(Ni-x)  -  jjiij  W1(N1-x-l) . 


By  taking  x  *  -j-  -  1  +  z  and  after  some  simple  computation,  we  have 


„(? I.,).  V!±f  (h 

i  V  2  zj  N.+2z  Ti  \  2 


z  +  1 


(4.2) 


N.+2-2Z  /N.  \ 

■  “iq+zr  Wi  \T  "  z  +  7‘ 


Then,  by  (4.2),  Lemma  4.1(c)  and  Induction,  we  conclude  that  for  each 
N1  \ 

z  =  1,2,...,  -j-  ,  iq  -  zl  can  be  represented  as  a  linear  function 
of  f.(y),  ye(0,l ,N.}. 

Ni 

Finally,  by  Lemma  4.1  (b),  we  also  see  that  for  each  x  =  +  l,...,fq, 

iq(x)  can  be  represented  as  a  linear  function  of  f ^ (y) ,  ye(0,l,...,N^}. 
Hence,  the  proof  of  this  theorem  Is  completed. 

By  Theorem  4.1,  for  each  x  =  0,1,...,^, 


W •  ( x)  *  l  s^.x.y)  f.  (y) , 
y*0 


(4.3) 


where  the  coefficients  B(fq,x,y)  depend  on  N. ,  x  and  y.  Also,  the 
values  of  e(N^,x,y)  can  be  obtained  from  Lemma  4.1  (c)  and  the  iterative 
relation  (4.2). 
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We  then  define 

N. 

win(x)  =  yl0  B<Nr*-*>  f!n(x> 

where  f!  (y)  have  been  defined  in  (4.1). 
in 

Now,  define 


(4.4) 


(W0n(x0)fin(xi)  "  Win(xi)f0n(x0)  if  p0  is  unknown‘ 
\  pOfin^xi ^  "  Win^xi^  if  p0  is  known’ 


and 


dl(«)  »  <l|A|n(*>  ±0).  (4.6) 

From  (4.1),  it  is  clear  that  f]n(x)  f^U)  with  probability  1  as 
n  ~  for  each  xe{0,1  ,. . .  ,Ni }.  Therefore,  from  (4.3)  and  (4.4), 
w]n(x)  ■*  W^(x)  with  probability  1  as  n  -*■  «  for  each  xe{0,1,...,N^}.  Thus 
we  have  the  following  theorem: 

Theorem  4.2.  Suppose  that  the  prior  distributions  G^(»)  are  symmetrical 
about  p  =  1/2  and  are  even  integers  for  all  i  =  (0),l,...,k.  Then,  the 

1  oo 

sequence  of  decision  rules  {dn)n=^  is  asymptotically  optimal  relative  to 
the  prior  distribution  G. 

Rate  of  Convergence  of  Empirical  Bayes  Rules  {d^} 

We  now  consider  the  rate  of  convergence  of  the  empirical  Bayes  rules 
{d^}.  Following  the  same  discussion  as  given  in  (3.4)  through  (3.6),  and 
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the  fact  that  the  estimators  {f]n(x)>  defined  in  (4.1)  share  the  same 
property  as  that  defined  in  (3.1),  it  suffices  to  consider  the  behavior 
of  P(w|n(x)  -  Wj(x)  >  6}  and  P(wjn(x)  -  W^(x)  <  -6}  as  n  +  «  for  some 
<5  >  0,  for  each  xe(0,l ,. . . ,N^ },  i  =  (0),  l,...,k. 

From  (4.3)  and  (4.4),  for  each  xe{0,l,...,N^}, 


(M1 

ptw]n(x)  -  w.(x)  >  6)  =  p|l  ^s(N1,x,y)  [f]n(y)-f1(y)]  >  6 


where  <5^  *  jijT+T'  S(N^,x,y)  ■  0  for  some  0  ^  y  <  ,  then 

Pf 6(Ni ,x,y)[f|n(y)  -  f|(y)]  >  6^ }  3  0.  So,  we  assume  B^.x.y)  +  0.  When 
B(Ni ,x,y)  >  0,  then 


P(B(N,.x,y)[f]n(y)-f((y)]  >  «,>  >  P(f]„(y)  -  f,(y)  > 

When  e(N^,x,y)  <  0,  then 

P{6(Ni,x,y)[f]n(y)  -  f^y)]  >  «,}  =  P(f|n(y)  -  fi(y)  <  «1/P(H1  ,x,y) }  . 


In  either  case,  the  problem  can  be  reduced  to  considering  the  convergence 
rate  of  P{|f]n(y)  -  f ^ (y) |  >  as  n  +  “  for  some  62  >  0.  Similarly, 
for  the  convergence  rate  of  P{wJn(x)  -  W^(x)  <  -6}  where  xe{0,l ,. . . ,N^ }  and 
6  >  0,  we  also  get  a  similar  result.  Therefore,  by  applying  Bernstein's 
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inequality  and  following  an  argument  similar  to  that  of  (3.7),  we  conclude 
the  following  theorem: 

1  oo 

Theorem  4.3.  Let  {d^ }n_i  be  the  sequence  of  decision  rules  defined  in  (4.6) 

1  «> 

Then,  tdn^n=i  is  asymptotically  optimal  at  least  of  order  exp{-c2n)  relative 
to  the  prior  distribution  G  for  some  c2  >  0. 

5.  Smooth  Empirical  Estimation  of  f..(x)  and  W..(x) 

In  this  section,  we  also  assume  that  G..(*)  are  symmetrical  about 
p  =  1/2  and  N.  are  even  integers  for  all  i  =  (0),  l,...,k.  In  Section  4, 
the  marginal  frequency  functions  f..(x),  xe{0,l ,. . . ,N^},  i  =  (0),  l,...,k,  ar 
estimated  in  terms  of  the  empirical  frequency  functions  f]n(x),  regardless 
of  the  properties  associated  with  the  marginal  function  f^x).  In  this 
section,  by  considering  some  properties  related  to  f.(x)  and  W.  (x),  two 
methods  for  smoothing  the  estimators  fjn(x)  and  wl n(x)  are  studied. 

We  first  need  the  following  lemmas. 

Lemma  5.1.  Suppose  that  (•)  is  symmetrical  about  p  =  1/2  and  is  an 
even  integer.  Then, 


(a) 

(y+Df^y+D  I  (^-y)  f^y)  and 

(5.1 

(b) 

Wi (y)  1  W.(N.-y) 

(5.2 

for  all  ye(0,l,...,Ni/2-l}. 

Lemma  5.1  can  be  verified  by  direct  computation.  We  omit  the 


proof  here. 


Lemma  5.2.  Let  U(x),  h(x)  be  nonnegative  functions  defined  on(0,l,...,N 
where  N  Is  an  even  positive  Integer,  and  satisfy 

(D  U(x)  =  U(N-x-l)  for  all  x  =  0,1 . N-l. 

(II)  U(x)  +  U(N-x)  =  h(x)  -  h(N-x)  for  all  x  =  0,1, ...,N  and 

(III)  U(x)  <  U(N-x)  for  all  x  =  0,1 . . ,N/2-l . 

Then, 

( 1 v)  (x+1)  h(x+l )  <  (N-x)  h(x)  for  all  x  =  0,1 ,. . . ,N/2-l . 

Proof:  Note  that  from  (1),  (N-x)  U(x)  =  (x+1)  U(N-x-l).  Then,  by  (11), 
we  obtain 

(N-x)  [h(x)  -  U (N-x) ]  =  (x+1)  [h(x+l )  -  U(x+1)]. 

Hence, 

(N-x)  h(x)  -  (x+1)  h(x+l) 

=  (N-x)  U(N-x)  -  (x+1)  U(x+1) 

>  (N-x)  U(x)  -  (x+1)  U(x+1 )  (by  (ill)) 

>  (N-x)  U(x)  -  (x+1)  U(N-x-l)  (by  (111)) 

■  (N-x)  [U(x)  ’  jjijU(N-x-l)] 

s  0  (by  (1)). 


Hence,  the  proof  of  this  lemma  is  completed. 


We  note  that  conditions  (i),  (ii)  and  (iv)  of  Lemma  5.2  do  not  imply 
that  U(x)  <_  U (N-x)  for  all  x  =  0,1 , . . .  ,N/2-l .  The  following  example 
illustrates  this  fact. 

Example.  Take  N  =  4.  Let 

U(0)  =  U ( 1 )  =  y|jy,  U(2)  =  U(3)  =  ylyjy,  U(4)  =  y|g-  and 

h(0)  =  0.1,  h(l )  =  0.3,  h{2)  =  0.2,  h(3)  =  0.3,  h(4)  =  0.1 

Then,  conditions  (i),  (ii)  and  (i)v)  are  satisfied  but  U(4)  <  U (0) . 

From  Lemma  5.1,  the  inequalities  (5.1)  and  (5.2)  are  always  true  for 

all  y  =  0,1 . Ni/2-l.  However,  the  empirical  frequency  functions  f|  (x) 

and  the  functions  w|n(x)  do  not  always  satisfy  the  above  inequalities. 

Hence,  it  is  reasonable  to  consider  some  smoothing  of  f]n(x)  and  w|n(x), 
which  will  satisfy  the  above  inequalities.  Two  smoothing  methods,  based  on 
f]n(x)  and  wl n( x) ,  respectively,  are  given  as  follows. 

Method  1.  Smoothing  Based  on  f 1 „(x) 

Let  Aj  >_  0  (for  Aj  >  0,  A ^  is  chosen  small).  Let  m1  stand  for  the  number 

of  times  the  smoothing  process  is  carried  out.  Algorithmically,  first  mj  =  0. 

Step  1.  m.  =  m.  +  1. 

1  1  N. 

For  each  y  =  0,  1,  ....  -  1,  let  e.^Aj,  y)  =  min(A1,  fjn(y)  +  f}n  (y  +  1)). 

Check  whether  (N^ -y)fl n(y)  -  (y+1  )f]n(y+l )  -  e1*n(A1»y)  ►  0  or  not.  If  not, 

Ni 

for  y  <  y  ■  2,  let 

ain(Ary)  =  [(y+l)fJn(y+l)-(N.-y)f]n(y)+ein(A1,y)]/(N.+l), 


f1n(y)  ’  *  'in*!'1  +  atn(V*>' 


f?n(y*'>  *  f?n'Nr^-’>  ■  -  a1n<4l  •»>  an<l 

fjn(x)  •  fj„{x)  for  all  x  t  y,  y  t  1,  l^-y-1,  t^-y. 
"t 

For  y  *  -j-  -  1 ,  let 


ain(Ary)  *  C(y+l)^n(y+1>  -  (Nry)fjn(y)  +  e1nUry)]  *  3^  , 

fin(y>  =  fin(lVy)  =  f1n(y)  +  \  a1n(Al’y)* 

f?n(y+D  -  f]n(y+i)  -  «1nUry)  and 

01  n.  N.  N. 

fjn(x)  *  fiVx)  for  a11  x  *  T  "  1  ’  T-  and  T-  +  1  • 


Step  2.  Let  eJn(Ary)  =  min^  ,f°h(y)  +  f°n(y+D).  Check  whether  (Nry)f°n(y) 

(y+1)f?n(y+i)  -  eir/Al,y)  -  0  for  all  y  ■  0,1,...,  -  1  or  not. 

If  yes,  go  to  step  3. 

If  no,  let  f|n(x)  =  f!j*n(x)  f°r  all  x  *  0,1,...,N.,  and  go  to  step  1. 

Ni 

Step  3.  Define  W°n<x)  =  ^  b(N1 ,x,y)fjn(y),  x  =  0,1 . Nr 


Remark  5.1 .  (1).  We  note  that  when  the  above  smoothing  procedure  stops, 
then  the  smooth  estimators  f®n(y)  have  the  property  that  (y+1 )f^n(y+l )  < 
(Ni-y)fJn(y)  for  all  y  =  0,1,..., -j-  -  1. 
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(2).  However,  it  is  possible  that  the  above  smoothing  procedure  never  stops. 

In  this  situation,  we  can  set  up  a  maximal  smoothing  time  to  stop  this 
procedure.  When  this  happens,  the  inequality  that  (y+1 )f!?n(y+l )  1  (N^ -y) f^n(y ) 
for  all  y  =  0,1,..., -y  -  1.  is  not  guaranteed. 

Based  on  the  smooth  estimators  f?n(x)  and  W®n(x),  we  define  decision 
.....  as  follows: 

<1l“0n<x0)f?n(xi)  '  “?n(x1)f0n(x0)  i  01  ff  p0  is 

l1lp0fin(V  ‘  w?n(xf)  -01  ifP01s 

Method  2.  Smoothing  Based  on  w|n(x) 

Let  >  0  (for  a2  >  0,  a?  is  chosen  small).  We  start  with  a  variable  m2 

which  stands  for  the  number  of  times  the  smoothing  carried.  At  first  m?  *  0. 
Step  1.  m,  s  m,  +  1. 

L  N.  ii 

For  each  y  =  0,  1,  ...»  -y  -  1.  let  <5.jn(A2,  y)  =  min(A2,  [W.n(y)+W^n(N^-y)]/2) 

and  bln(A2.  y)  -  [*}n(y>  -  «}n(H,  -  iW  *  «1n<V  *>. 

Check  whether  wj^Nj-y)  >  w]n(y)  +  <$in(A2,y)  or  not-  If  not’  for  y  =  °*  1et 


unknown; 

known. 


rules  d|j(. ) ,  n  =  1 ,2 


<5(>0  ■ 

n  r\> 


W*n(0)  =  w]n(0)  -  d(0)binU2,0), 

W*n(NrD  =  NiW^n(0)  and 

W*n(x)  =  w]n(x)  for  all  x  f  0,  N.-l,  Nr 


For  1  _<  y  _<  -j-  -  1 ,  let 


wtn(Nry)  ■  “!n(Nr1')  * 

«(n(y)  =  “j„(y)  -  d(y)b1n<i2,y), 

Vr»-')-FrV 

“in'1"11  *  H^P+T  "tn(N1-J,)  and 

“Tn*x*  ’  “!n*x*  for  3,1  x  »•  y-1 *  y>  N,-y-l .  Nj-y. 

N. 

Here,  c(y)  =  2(N.-y+l)/(Ni+2) ,  d(y)  =  2(y+l )/(N.+2)  for  y  =  0,1 . - 

Step  2.  Let  6*n  (A^.y)  *  min(A2,[W*n(y)  +  W|n(ri1-y)]/2) .  Check  whether 

N. 

Win(y)  +  6in(A2’y)  -  Win(Ni'y)  f°r  all  y  =  0,1 . -  1  or  not. 

If  yes,  go  to  step  3. 

If  no,  let  w]n(x)  =  W^n(x)  for  all  x  =  0,1, ...,N^  and  go  to  step  1. 

Step  3.  Let  f*n(y)  =  W*R(y)  +  W%(N.-y)  for  all  y  =  0,1,..., N.. 

Remark  5.2.  (1)  We  note  that  when  the  above  smoothing  procedure  stops, 

then  the  smooth  estimators  W*n(y)  satisfy  that  W^n(y)  <  W|n(N.-y)  for 
all  y  =  0,1,.  -  1,  W*n(y)  =  ^  Hf^^-y-l)  for  all  y  =  0,1,.  ..,N. 

and  W|n(y)  +  W*n(Nry)  =  f*n(y)  =  f*n(Nry)  for  all  y  =  0,1 . N..  The 

by  Lemma  5.2,  (y+l)ffn(y+l)  <  (Nry)f*n(y)  for  all  y  =  0,1,...,^-  -  1. 
Therefore,  method  2  is  better  than  method  1  in  this  sense. 
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(2)  It  is  also  possible  that  the  above  smoothing  procedure  never  stops. 
Hence,  we  can  set  up  a  maximal  smoothing  time  to  stop  this  procedure. 

When  this  happens,  for  the  smooth  estimators,  the  inequality  properties 
of  (5.1)  and  (5.2)  are  not  guaranteed. 

Based  on  the  smooth  estimators  f*n(x)  and  W|n(x),  we  define  decision 
rules  d*(.),  n  =  1,2,...,  as  follows: 


!1l"on(xO)f1n(x1>  -  Uin(x1)f0n(x0)  i  01  1f  p0  is  unknown' 


w  ■  (1| 


POfin<x()  - 


if  Pq  is  known. 


6.  Monte  Carlo  Studies 


oo 

For  the  sequence  of  decision  rules  ^6n(x)^n=^,  the  conditional  Bayes 
risk  at  stage  n  +  1  given  (^,* -•,-$„)  is 

R(G,«n)  =  /n  l  L(p,«n(^))  f(^ljg)  dG(j0) . 


00 

To  measure  the  performance  of  the  sequence  of  decision  rules  *6nU^n=i» 
computing  the  overall  risk  r(G,|5n)  =  ER(G,<5n)  is  needed,  where  the  expectation 
E  is  taken  with  respect  to  (^ ,. . .  ,J£  ).  For  the  small  sample  situation,  it  is 
impossible  to  analytically  determine  such  values.  Therefore,  Monte  Carlo 
simulation  is  employed. 

In  this  section,  we  have  carried  out  some  Monte  Carlo  studies  to  see 
the  performance  of  the  sequences  of  decision  rules  (d^l,  ^d^}  and  { d* } .  We 
let,  conditional  on  p^ ,  Xi  ^  B(Ni )  where  are  even  integers  for  i  =  0,  1 
and  pn  is  treated  as  unknown.  We  also  assume  that 
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p  r(2a*+2)  aj  a- 

s.-(p)  =  /  - 5 — py’d-yl^y.i^o,1. 

1  0  [r(a.+l)  2 


Hence,  the  Bayes  rule  dg  is: 


Select  tt-j  as  good  if 


Xg+dfl+l  X-j+a  1+1 

N0+2a0+2  -  N1+2a1+2  * 


A  random  sample  of  size  50  was  generated  by  computing  from  a  population 
having  fj(x)  (i=0,l)  as  probability  function.  For  each  n  =  1,2,..., 50, 
the  conditional  Bayes  risks  R(G,d^),  R(G.d^)  and  R(G,d*)  were  calculated. 

One  hundred  repetitions  were  performed.  Estimates  of  the  overall  risks 
r(G.d^),  r(G,djj)  and  r(G,d*)  were  obtained  by  averaging  the  associated 
conditional  Bayes  risks  and  the  standard  deviations  of  the  estimated 
overall  risks  were  also  obtained  based  on  these  repeated  samples. 

In  Tables  1-4,  we  consider  the  combinations  of  different  N . ' s  and 
a j 1 s  values  for  our  decision  problem.  We  let  r(G,6n)  denote  the  average 
of  100  R(G,6n)  values  obtained  from  simulation.  The  standard  deviation 
associated  with  r(G,<5n)  is  given  in  the  corresponding  parentheses.  It  is 
easy  to  see  that  the  performances  of  the  sequences  of  decision  rules  {d®} 
and  { d* }  are  always  better  than  that  of  { } ,  for  the  cases  that 
(Nq,  Nj ,  ag,  «i)  =  (2, 2, 4, 4)  and  (Ng.Nj  .ag,^)  =  (2, 2, 6, 6),  both  of  them 
have  the  same  performance.  For  the  other  (Ng.Nj  .ag,^) 's,  the  performance 
of  {d*}  is  always  better  than  that  of  {d®}. 

It  is  also  interesting  to  note  that  in  most  cases,  r(G,d*)  has  the 
smallest  standard  deviation  while  r(G,d^)  has  the  largest  standard  deviation. 
This  fact  indicates  that  the  behavior  of  the  sequence  of  decision  rules  (d*> 
is  more  stable  than  the  others. 
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TABLE  1 

Simulation  results  for  the  comparative  performance  of  sequences 

of  empirical  Bayes  rules  {d*},  {d®>  and  {d*}. 
r  n  n  n 


(Nq,  Nj,  Oq,  a2)  =  (2,  2,  4.  4),  r(G)  =  0.05287 


n 

r(G,  dj) 

r(G.  dj|) 

r(G,  dj) 

1 

0.08936 

0.06299 

0.06299 

(0.00118) 

(0.00073) 

(0.00073) 

2 

0.08426 

0.05907 

0.05907 

(0.00171) 

(0.00062) 

(0.00062) 

3 

0.09188 

0.05638 

0.05638 

(0.00213) 

(0.00053) 

(0.00053) 

5 

0.08745 

0.05452 

0.05452 

(0.00227) 

(0.00038) 

(0.00038) 

10 

0.08299 

0.05298 

0.05298 

(0.00222) 

(0.00010) 

(0.00010) 

15 

0.07899 

0.052B7 

0.05287 

(0.00251) 

(0.00000) 

(0.00000) 

20 

0.07767 

0.05287 

0.05287 

(0.00243) 

(0.00000) 

(0.00000) 

25 

0.07849 

0.05287 

0.05287 

(0.00234) 

(0.00000) 

(0.00000) 

30 

0.07481 

0.05287 

0.05287 

(0.00212) 

(0.00000) 

(0.00000) 

35 

0.07328 

0.05287 

0.05287 

(0.00215) 

(0.00000) 

(0.00000) 

40 

0.07215 

0.05287 

0.05287 

(0.00203) 

(0.00000) 

(0.00000) 

45 

0.07200 

0.05287 

0.05287 

(0.00213) 

(0.00000) 

(0.00000) 

50 

0.07157 

0.05287 

0.05287 

(0.00212) 

(0.00000) 

(0.00000) 

TABLE  2 


Simulation  results  for  the  comparative  performance  of  sequences 
of  empirical  Bayes  rules  {d^> ,  {djj}  and  {d*}. 

(Nq,  Nr  aQ,  ax)  *  (2,  2,  6,  6),  r(G)  =  0.04896 


n 

r(G,  dj) 

r(G,  djj) 

r(G,  dj) 

1 

0.07640 

0.05626 

0.05626 

(0.00089) 

(0.00056) 

(0.00056) 

2 

0.07188 

0.05284 

0.05284 

(0.00126) 

(0.00043) 

(0.00043) 

3 

0.07577 

0.05121 

0.05121 

(0.00160) 

(0.00038) 

(0.00038) 

5 

0.07272 

0.04965 

0.04965 

(0.00175) 

(0.00022) 

(0.00022) 

10 

0.07098 

0.04P96 

0.04896 

(0.00164) 

(0.00000) 

(0.00000) 

15 

0.07111 

0.04896 

0.04896 

(0.00189) 

(0.00000) 

(0.00000) 

20 

0.07090 

0.04896 

(0.04896) 

(0.00173) 

(0.00000) 

(0.00000) 

25 

0.06931 

0.04896 

(0.04896) 

(0.00185) 

(0.00000) 

(0.00000) 

30 

0.06904 

0.04896 

0.04896 

(0.00176) 

(0.00000) 

(0.00000) 

35 

0.06938 

0.04896 

0.04896 

(0.00181) 

(0.00000) 

(0.00000) 

40 

0.06855 

0.04896 

0.04896 

(0.00171) 

(0.00000) 

(0.00000) 

45 

0.06860 

0.04896 

0.04896 

(0.00169) 

(0.00000) 

(0.00000) 

50 

0.06681 

0.04896 

0.04896 

(0.00169) 

(0.00000) 

(0.00000) 
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TABLE  3 


Simulation  results  for  the  comparative  performance  of  sequences 
of  empirical  Bayes  rules  {dj},  {d°}  and  {d*}. 

(Nq,  N1#  aQ»  ax)  =  (4,  4,  4.  4),  r(G)  =  0.04114 


n 

r(G.  dj) 

r(G,  dj) 

r(G,  d*) 

1 

0.08641 

0.07389 

0.06350 

(0.00030) 

(0.00123) 

(0.00123) 

2 

0.09043 

0.06071 

0.05480 

(0.00168) 

(0.00164) 

(0.00116) 

3 

0.08626 

0.06396 

0.05026 

(0.00069) 

(0.00131) 

(0.00092) 

5 

0.08595 

0.05851 

0.04613 

10 

(0.00174) 

(0.00156) 

(0.00069) 

0.08479 

0.05546 

0.04274 

15 

(0.00145) 

(0.00147) 

(0.00035) 

0.07992 

0.05596 

0.04189 

20 

(0.00161) 

(0.00147) 

(0.00016) 

0.07994 

0.05536 

0.04148 

25 

(0.00156) 

(0.00145) 

(0.00010) 

0.07514 

0.05358 

0.04155 

30 

(0.00185) 

(0.00133) 

(0.00011) 

0.07674 

0.05446 

0.04144 

(0.00157) 

(0.00141) 

(0.00011) 

35 

0.07458 

0.05449 

0.04144 

(0.00156) 

(0.00139) 

(0.00010) 

40 

0.07024 

0.05312 

0.04168 

45 

(0.00158) 

(0.00130) 

(0.00013) 

0.06855 

0.05267 

0.04158 

(0.00145) 

(0.00126) 

(0.00013) 

50 

0.06749 

0.05187 

0.04158 

(0.00152) 

(0.00119) 

(0.00012) 
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TABLE  4 


Simulation  results  for  the  comparative  performance  of  sequences 
of  empirical  Bayes  rules  (dp),  {d®}  and  {d*}. 

(Nq,  Nj,  o0,  aj)  *  (4,  4,  6,  6),  r(6)  =  0.03970 


n 

r(G,  dj) 

r(G,  dj}) 

r(G,  dj) 

1 

0.07415 

0.06354 

0.05607 

(0.00020) 

(0.00088) 

(0.00087) 

2 

0.07609 

0.05526 

0.04950 

(0.00117) 

(0.00119) 

(0.00073) 

3 

0.07333 

0.05737 

0.04669 

(0.00057) 

(0.00104) 

(0.00066) 

5 

0.07158 

0.05513 

0.04275 

(0.00110) 

(0.00108) 

(0.00051) 

10 

0.07102 

0.05097 

0.04079 

(0.00132) 

(0.00103) 

(0.00024) 

15 

0.06987 

0.05202 

0.04006 

(0.00102) 

(0.00106) 

(0.00009) 

20 

0.06907 

0.05035 

0.04001 

(0.00122) 

(0.00105) 

(0.00009) 

25 

0.06632 

0.04973 

0.04004 

(0.00121) 

(0.00100) 

(0.00010) 

30 

0.06748 

0.05067 

0.04004 

(0.00118) 

(0.00099) 

(0.00010) 

35 

0.06669 

0.05024 

0.03997 

(0.00136) 

(0.00101) 

(0.00009) 

40 

0.06712 

0.05034 

0.04004 

(0.00118) 

(0.00098) 

(0.00009) 

45 

0.06626 

0.05110 

0.03987 

(0.00129) 

(0.00101) 

(0.00006) 

50 

0.06373 

0.05042 

0.03992 

(0.00126) 

(0.00102) 

(0.00008) 
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